Remote control unit for a programmable multimedia controller

ABSTRACT

In one embodiment, a menuing system is overlaid upon a portion of a video being shown on a display device coupled to a programmable multimedia controller. The portion of the video is less than an entire screen of the video such that at least some of the video is still visible. The menuing system has a plurality of selectable options. In response to a scrolling gesture in a direction, an element is moved in a corresponding direction within the menuing system to bring the element to a designated position in the menuing system to permit selection of a particular selectable option. In response to selection of the particular selectable option, one or more control commands are issued to a device coupled to the programmable multimedia controller to control an aspect of operation of the device.

RELATED CASES

This application is a continuation of U.S. patent application Ser. No.11/520,328 entitled REMOTE CONTROL UNIT FOR A PROGRAMMABLE MULTIMEDIACONTROLLER, filed Sep. 13, 2006 by Robert P. Madonna, et al. thecontents of which are expressly incorporated by reference.

This application is related to the following U.S. patent applications:

Ser. No. 11/314,112 entitled MULTIMEDIA CONTROLLER WITH PROGRAMMABLESERVICES, by Robert P. Madonna, et al., and

Ser. No. 11/314,664 entitled SYSTEM AND METHOD FOR A PROGRAMMABLEMULTIMEDIA CONTROLLER, by Robert P. Madonna, et al, the contents of bothof which are expressly incorporated by reference.

BACKGROUND OF THE DISCLOSURE

1. Field of the Disclosure

The present disclosure relates generally to device control, and moreparticularly to a remote control unit for a programmable multimediacontroller that controls a variety of electronic devices, such as audiodevices, video devices, telephony devices, data devices, securitydevices, motor-operated devices, relay-operated devices, Internetaccess/browser devices, general-purpose computers, handicap assistancedevices, and/or other types of devices.

2. Background Information

With the ever increasing complexity of electronic devices, simple yeteffective device control is becoming increasingly important. While onceelectronic devices could adequately be controlled with only a handful ofanalog knobs and switches, modern electronic devices often present userswith a vast array of configurable options and parameters, which requirecomplex controls to manipulate and select. In response to users' demandsfor “convenience,” these controls are often implemented on handheldremote control units, which use Infrared (IR), radio-frequency (RF), orother types of signals to interface with the electronic devices beingcontrolled. Yet actual convenience is seldom achieved with conventionalremote control units.

Users are typically burdened with having to manipulate a number ofseparate, device-specific remote control units, each of which typicallyimplements a different control scheme. Thus, to perform even basicfunctions, a user must have all the required remote control units onhand, and be familiar with how to manipulate each one. Further, the usermust understand how their devices are interconnected, so that they mayselect appropriate inputs for passing signals between the devices. Forexample, if a user desires to watch a DVD movie with the lights dimmedand a telephone ringer suppressed, he may have to operate threeAudio/Video (A/V) remote control units, one for a DVD player, one for atelevision, and one for an Audio/Video (A/V) receiver, as well as aremote control unit for a device controller, such as an X10™ lightingcontroller, in addition to manipulating a handset of a cordlesstelephone (in a sense, yet another remote control unit). Each of theseremote control units generally operates differently, and the user musttransition between several control schemes to perform the desiredfunctions. Further, the user must select the proper inputs for eachdevice, for example so that the video signals from the DVD player willmake their way through the A/V receiver for display on the television.

Many of the control schemes commonly employed with remote control unitsare non-intuitive and difficult to use. Most remote control units aredesigned with a button-centric paradigm, such that numerousfunction-specific buttons are crowded into a relatively small space onthe face of the remote control unit. The crowded button layout ofbutton-centric remote control units often makes it difficult to select adesired button from the many buttons available, especially in low-lightconditions. If a user inadvertently presses the “wrong” button, a devicemay perform an unwanted action or enter an undesired mode or state. Thismay confuse or aggravate the user. Further, sometimes a user may beuncertain which button to press in order to activate a desired function.In such a situation, the user may have to decipher abbreviated (oftencryptic) legends printed on, or about, the buttons of the remote controlunit. As these legends are often only a few characters long, a user mayhave to refer to a manual to determine what the legends mean, and whatfunctions are associated with each button. In short, many button-centricremote control units are far from intuitive and easy-to-use.

Furthermore, while a variety of so-called “universal” remote controlunits exist that claim to improve upon the shortcomings ofdevice-specific remote control units, conventional “universal” remotecontrols generally fall far short of their claims. Typical “universal”remote control units simply map the functionality of the buttons ofdevice-specific remote control units to buttons of the “universal”remote control. The underlying control schemes are generally notaltered. So, while the control schemes of the device specific remotecontrol units are all implemented on a single remote control unit, theyare not unified or simplified in any way. Further, since conventional“universal” remote control units attempt to control a range of devices,they typically have even more buttons with cryptic legends thandevice-specific remote controls. Thus, the problems of a button-centricparadigm are aggravated. Also, most “universal” remote control unitstend to be far from universal, as they typically do not operate withdevices other than audio and video devices. For example, conventional“universal” remote controls do not generally include functionality forcontrolling telephony devices, data devices, security devices,motor-operated devices, relay-operated devices, Internet access/browserdevices, general-purpose computers, handicap assistance devices, and/orother types of devices.

In addition, a variety of high-end touch-panel controllers exist thatpurport to improve upon device-specific remote control units. Forexample, Crestron Electronics, Inc. of Rockleigh, N.J. offers a line ofhigh-end touch-panel controllers that are widely available. Thesetouch-panel controllers incorporate central processor units, graphicscontrollers, I/O interfaces and other complex components similar tothose found in portable computers, rendering them complicated and costlyto manufacture. Further, such touch-screen controllers generally requireextensive custom programming to adapt to particular installations. Thus,their complexity and cost renders them unsuitable for many applications.

Furthermore, high-end touch-panel controllers, conventional “universal”remote control units, and device specific remote control units typicallylack any type of location-awareness, i.e. the ability to incorporateknowledge of the remote control unit's current location into the controlscheme, or user-awareness, i.e. the ability to incorporate knowledge ofthe remote control unit's current user into the control scheme. Thisburdens the user, requiring the user to make making all locationdependent decisions themselves and forgo the convenience ofuser-dependent control.

For example, considering the lack of location dependent control inconventional systems, suppose a user has several televisions in his orher home, and wishes to turn on a television located in the room inwhich he or she is sitting. With a conventional remote control unitcapable of controlling all the televisions, the user generally mustselect the particular television with a first button of the remotecontrol. The user must remember which button this is, or the remotecontrol unit must be labeled in some way. Only after the correcttelevision is selected, may the user select a second button to actuallyturn it on. A guest or other person unfamiliar with the remote controlunit, and its control scheme, may not know which television correspondswith which button. Thus, a simple action may become quite daunting, andrequire trial and error to execute.

As the number of devices controlled by a remote control unit grows, thedifficulties caused by a lack of location-awareness become even moreapparent. For example, suppose a user has configured lighting fixturesthroughout a home to be operable remotely using a device controller,such as an X10™ lighting controller. In such a configuration thelighting fixtures may readily be turned on and off with a remote controlunit. Yet using a conventional control scheme on the remote controlunit, a user would be required to select from a long list of availablelighting fixtures, often mapped to dozens of different buttons, tosimply turn on the fixture in the room he or she is entering. As isapparent, this would be quite burdensome to do each time one desires toturn on a light, and much of the convenience of remotely controlledlighting is lost.

Similarly, turning to the lack of user-dependent control in conventionalsystems, suppose several users each have their own individualpreferences relating to control schemes, for example, individualpreferences for certain options to be displayed, certain colors to beused, and/or other aesthetic or functional preferences. With aconventional system, even if a mechanism is provided to adjust theseparameters, the same adjustment will be shown to all users. A user whodesires to have his or her own personal control scheme is notaccommodated.

What is needed is an improved remote control unit that addresses theabove described shortcomings. Such a remote control unit should operatewith a programmable multimedia control for controlling andinterconnecting a variety of electronic devices, such as audio devices,video devices, telephony devices, data devices, security devices,motor-operated devices, relay-operated devices, Internet access/browserdevices, general-purpose computers, handicap assistance devices, and/orother types of devices.

SUMMARY OF THE DISCLOSURE

A remote control unit is provided for operating a programmablemultimedia controller, the remote control unit including an annulartouch sensor for manipulating an annular menuing system displayed on adisplay device. In one embodiment, the annular menuing system includes anumber of selectable options displayed as text or graphic icons. Inresponse to a user gesturing by scrolling clockwise or counter-clockwiseabout the annular touch sensor, pressing firmly on the annular touchsensor, or tapping at a particular location on the annular touch sensor,the selectable options rotate in the annular menuing system. A user mayfully direct their visual attention to the annular menuing system, asthe remote control unit may be manipulated from tactile sensation. Whenan option is brought to a designated position in the menuing system, itis selected by a further action of the user. In a second embodiment, theannular menuing system includes a number of regions displayed in anannular manner, and a selection cursor is disposed upon the menuingsystem. In response to a user gesturing on the annular touch sensor byscrolling clockwise or counter-clockwise, the selection cursor is movedin that direction on the annular menuing system. Alternately, bypressing firmly or tapping at a particular location on the annular touchsensor, a region located at a corresponding location of the annularmenuing system is selected. By selection of selectable options orregions, corresponding numerals, characters, text, devices, commands,Internet web pages, menus, or other options may be chosen. In thismanner, the combination of the annular menuing system and the remotecontrol unit with the annual sensor may replicate many of the functionsprovided by a mouse and keyboard, facilitating detailed control absentbulky input devices.

The remote control unit is further configured to implementlocation-awareness features. In one embodiment, a number oftransmitter/receiver units are dispersed throughout a structure wherethe programmable multimedia controller is located, for example theuser's home. Depending on the location of the remote control unit, asignal transmitted therefrom is received by one or more of thetransmitter/receiver units. Using the signal strength received at thetransmitter/receiver units, or alternately triangulation techniques orglobal positioning techniques, the location of the remote control unitis determined. Thereafter, control is adapted to this location, and tothe devices located nearby to this location. For example, the menuingsystem described above may be disco played on the display most proximateto the location, as opposed to more distantly located displays.Similarly, when a user attempts to control a device, of which severalare available at different locations, the nearest device isautomatically selected and controlled, absent explicit specification bythe user. For example, if several televisions are located in thestructure, and the user selects to turn on a television, the televisionmost proximate to the remote control unit will be activated, i.e. thetelevision in the room in which the user is located. In such manner, theuser is freed from explicitly specifying the device to be controlledwhere a particular device is determined (or assumed) to be the subjectof the user's intentions.

Further, the remote control unit is configured to implementuser-awareness features. In one embodiment, a remote control unit isassociated with a particular user. When the user manipulates his or herremote control unit, a user profile is accessed and user-specificoptions applied to the control scheme. For example, a user may haveselected certain menu arrangements, colors, or styles that suit personalpreferences, and these will be displayed. Similarly, one user may haveaccess to certain devices or services controlled or offered by theprogrammable multimedia controller, while another user may not have suchaccess. In this manner, control options and access privileges may beunique to a particular remote control unit and thus to the user thatoperates that unit.

BRIEF DESCRIPTION OF THE DRAWINGS

This disclosure may be better understood by referring to the followingdescription in conjunction with the accompanying drawings in which likereference numerals indicate identical or functionally similar elements:

FIG. 1 is a block diagram of an illustrative programmable multimediacontroller, interconnected to a number of devices, which may be used inconjunction with the remote control unit disclosed herein;

FIG. 2 is a schematic block diagram showing a high-level hardwarearchitecture of the illustrative programmable multimedia controller;

FIG. 3A is a schematic diagram of an example annular touch sensor thatmay be incorporated into a remote control unit;

FIG. 3B is a schematic diagram of example switches and related circuitrythat may be used in conjunction with the annular touch sensor in aremote control unit;

FIG. 4 is a schematic diagram of an example remote control unit thatincorporates an annular touch sensor;

FIG. 5 is a diagram of a first example annular menuing system adapted tothe shape of the annular touch sensor of FIG. 3;

FIG. 6A is a diagram of a second example annular menuing system adaptedto the shape of the annular touch sensor of FIG. 3;

FIG. 6B is a diagram of an example linear menuing system that may becontrolled by gestures on the annular touch sensor of FIG. 3; and

FIG. 7 is a schematic diagram depicting an example technique forproviding location-awareness functionality to a remote control unit.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

FIG. 1 is a block diagram of an illustrative programmable multimediacontroller 100, interconnected to a number of devices, which may be usedin conjunction with the remote control unit disclosed herein. The term“programmable multimedia controller” should be interpreted broadly as adevice capable of controlling, switching data between, and/or otherwiseinteroperating with, a variety of electronic devices, such as audiodevices, video devices, telephony devices, data devices, securitydevices, motor-operated devices, relay-operated devices, Internetaccess/browser devices, general-purpose computers, handicap assistancedevices, and/or other types of devices. A programmable multimediacontroller may be configured to perform all these functions and workwith all these devices, or to perform a selected subset of functions andoperate with a selected subset of devices.

In the example of FIG. 1, the programmable multimedia controller 100 isconnected to a wide range of audio/video components, for example, acompact disk (CD) player 105, a digital video disc (DVD) player 110, anaudio/video receiver 115, a television 120, a personal media player 125,speakers 122, a microphone 123, and/or a video camera 124. Theprogrammable multimedia controller is also connected to telephonydevices such as a telephone network 130 and telephone handsets 132. Thetelephone network 130 may be a publicly switched telephone network(PSTN), an Integrated Services Digital Network (ISDN) or othercommunication network.

In addition, the programmable multimedia controller intercommunicateswith variety of lighting and/or home automation systems 135. Thesedevices may operate via the X10 protocol developed by Pico Electronics,the INSTEON™ protocol developed by SmartHome, Inc, the CEBus standardmanaged by the CEBus Industry Council, RS232, or another well knownautomation or control protocol. Similarly the controller is connected tomotor and/or relay operated devices 137 that may include, for example, aheating, ventilation and air conditioning (HVAC) system, an irrigationsystem, an automatic shade or blind system, an electronic door lock, orother types of devices.

A computer network, such as the Internet 140, is connected to theprogrammable multimedia controller. In addition, a personal computer(PC) 145, video game systems 150, home or studio recording equipment 165or other devices may also be connected. Further, one or more remotecontrol units 400 are provided to manage the controller's functionality,and/or to control devices connected to the controller. Details of theconfiguration of such remote control units may be found below,especially in relation to FIGS. 4-6. Each remote control unit may beinterconnected to the controller via a wired network connection or awireless connection such as an infra-red link, a radio-frequency link, aBluetooth™ link, a ZigBee™ link, WirelessUSB™, Certified Wireless USB,WI-FI, or another appropriate data connection. Further, each remotecontrol unit may be interconnect directly to the programmable multimediacontroller 100, or interconnected through one or more separatetransmitter/receiver units (not shown) that relay commands back to theprogrammable multimedia controller, and/or provide other functions.Further detail relating to such transmitter/receiver units is foundbelow in reference to FIG. 7.

In addition to providing interconnection to a wide variety of devices,the programmable multimedia controller is able to combine, synthesize,and otherwise processes various data types to implement an integratedmultimedia solution for a user. A detailed description of the variousnovel services and capabilities that may be provided is available inMULTIMEDIA CONTROLLER WITH PROGRAMMABLE SERVICES, by Robert P. Madonna,et al.

To facilitate the above described interconnections and processing, theprogrammable multimedia controller 100 may be arranged in a modularmanner. For example, in one embodiment, the programmable multimediacontroller 100 is arranged to have twelve separate input and outputmodules, each having a number of connection ports. The input and outputmodules are inserted into slots or module bays of the programmablemultimedia controller 100. The modules interface with a mid-plane thatprovides connection to the rest of the system. By embracing a modularapproach, a user is allowed to select the specific modules desired, andthe system may be customized to fit a particular application. Inaddition, entry level pricing may be reduced by allowing a user topurchase a base configuration, with limited capabilities, and then addto the system by purchasing addition modules. Several examples ofmodules are discussed in SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIACONTROLLER, by Robert P. Madonna, et al. It is expressly contemplatedthat a wide variety of additional modules may be provided. It is alsocontemplated that several programmable multimedia controllers may beinterconnected to create a larger system, in effect implementing amodular-type solution at the controller level. Further details regardingsuch interconnection and expansion may also be found in SYSTEM ANDMETHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER, by Robert P. Madonna,et al.

FIG. 2 is a schematic block diagram showing a high-level hardwarearchitecture of the illustrative programmable multimedia controller. Thevarious components shown may be arranged on a “motherboard” of thecontroller, or on a plurality of cards interconnected by a backplane(not shown). A microcontroller 210 manages the general operation of thesystem. The microcontroller 210 is coupled to an audio switch 215 and avideo switch 220 via a bus 218. The audio switch 215 and the videoswitch 220 are preferably crosspoint switches capable of switching anumber of connections simultaneously. However many other types ofswitches capable of switching digital signals may be employed, forexample Time Division Multiplexing (TDM) switches or other devices.

A mid plane 235 interconnects the switches to a variety of input andoutput modules such as, for example, Digital Video Input Modules withHDMI 290, Video Output Modules with HDMI 292, Digital Audio InputModules 294, and Digital Audio Output Modules 296. The mid plane 235 isfurther coupled to an Ethernet switch 230 that permits switching of 10BaseT, 100 BaseT or Gigabyte Ethernet signals. The Ethernet switch 230interconnects Ethernet ports 232 and a processing subsystem 240 to themicrocontroller 210. In one embodiment, the processing subsystem 240includes a plurality of small form factor general purpose personalcomputers that provide redundant operation and/or load balancing. Insome embodiments, the processing subsystem 240 may include one or morestorage devices, external to the personal computers, to provide expandedstorage capacity, for example, to store digital media.

Also, a number of Universal Serial Bus (USB) ports 242 areinterconnected to a USB hub 243 for interconnection to the processingsubsystem 240. A memory card interface 225 may also be connected to theUSB hub 243. The interface accepts one or more well-known memory cardformats, for example CompactFlash™ cards, Memory Stick™ cards, SecureDigital™ (SD) cards, or other formats. A USB switch 244 is employed toswitch USB links among the multiple processing components that may bepresent in the processing subsystem 240. In a similar manner, a numberof IEEE 1394 (FireWire™) ports 246 are interconnected to an IEEE 1394hub 247 and to an IEEE 1394 switch 248.

The microcontroller 210 is further connected to a Serial PeripheralInterface (SPI) and Inter-Integrated Circuit (I²C) distribution circuit250, which provides a serial communication interface to relatively lowdata transfer rate devices. The SPI/I²C controller 250 is connected tothe mid-plane connector 235 and thereby provides control commands fromthe microcontroller 210 to the modules and other devices in theprogrammable multimedia controller 100. Further connections from SPI/I²Ccontroller 250 are provided to devices such as a fan controller 251, atemperature sensor 252 and a power manager circuit 253, which manage thethermal characteristics of the system and prevent overheating.

The microcontroller 210 is also connected to Infra-Red (IR) interface260, an RS232 interface 265, and an RF interface 267, that permitinterconnection with external devices. Such interaction permitsprogrammable multimedia controller 100 to control external devices. Inaddition, the interfaces may receive control signals that control theoperation of the programmable multimedia controller itself. It isexpressly contemplated that various other interfaces, including WI-FI,Bluetooth™, ZigBee™, WirelessUSB™, Certified Wireless USB, and otherwired and wireless interfaces, may be used with the multimediacontroller 100.

In addition, an Auxiliary Audio/Video Port 298 is provided forinterconnecting one or more video game systems, camcorders, computers,karaoke machines, or other devices. A telephone interface 270 isprovided for connecting to the public switch telephone network or to aprivate network, and to connect to one or more telephone handsets.Further, a device control interface 275 is provided to communicate withlighting, home automation, and motor and/or relay operated devices. Asdiscussed in more detail below, an expansion port 280 is provided forlinking several programmable multimedia controllers together to form anexpanded system. Finally, a front panel display 285 permits presentationof status, configuration, and/or other information to a user. In oneembodiment the front panel display may accept video data originatingfrom any input source connected to the system, such that a user maypreview video content on the front panel display 285. In anotherembodiment, the front panel display 285 includes a touch sensitivescreen, and a user may enter control selections by selecting icons orother representations on the screen. In this manner the front paneldisplay 285 may be used for control and configuration of the system.

In addition to controlling the programmable multimedia controller 100using the front panel display 285, the programmable multimediacontroller 100 may be controlled by the one or more remote control units400, as is described in detail below.

FIG. 3A is a schematic diagram of an example annular touch sensor thatmay be incorporated into a remote control unit. Use of such an annulartouch sensor may obviate the need for many of the buttons found on aconventional button-centric remote control unit. While a variety ofannular touch sensors are commercially available, and techniques fortheir design and manufacture using force sensitive resistor (FSR)technology or capacitive sensing technology (for example CapSence™technology available from Cyress Semiconductor Co.) are well-known inthe art, the basic design of one type of touch sensor is describedherein to assist the reader. As used herein, the term “annular” shouldbe interpreted to refer to any possible ring-like shape into which atouch sensor may be formed, for example, a circular, elliptical,triangular, or polygonal shape. The term “annular” should also beinterpreted to encompass both closed shapes having a continuous path,for example a circle, and open shapes having a non-continuous path, forexample a U-shape with an open portion.

The example annular touch sensor operates according to potentiometricprinciples, thereby translating a user's gestures into electronicsignals. Referring to FIG. 3A, a bottom substrate 310 contains a finegrid of highly conductive traces that are supplied with voltage. Aflexible top substrate 330 is disposed above the bottom substrate 310and spaced there from by a spacer layer 320. The spacer layer 320 isthick enough to prevent the lower face of the top substrate 330 fromcontacting the bottom substrate 310 except when it is touched by a userand thereby deflected into contact with the bottom substrate 310. Thetop substrate 330 is conductive on its lower face and when brought intocontact with the grid of conductive traces on the bottom substrate 310,voltage is passed there-between. The voltage passed is generallyproportional to the location of the touch by the user. By varying whichtraces of the bottom substrate 310 are charged with voltage, and bytaking multiple measurements of the voltage transferred to the topsubstrate 330, information sufficient to decipher a user's gestures isobtained. This information is thereafter processed by a processor toprovide electrical signals descriptive of the user's gesture. Forexample, if a user touches and holds on the top substrate, slides toanother location, and then releases, the annular touch sensor 300 willcapture a series of voltage readings that are deciphered to yield thestarting location, path, speed, duration of travel, and ending locationof the user's gesture. Similarly, if a user simply lightly taps the topsubstrate at a particular location, the annular touch sensor capturesseries of voltage readings that are deciphered to yield the location,and duration of the tap.

FIG. 3B is a schematic diagram of example switches and related circuitrythat may be used in conjunction with the annular touch sensor in aremote control unit. In addition to detecting tapping and scrollinggestures, in some embodiments, a firm press upon the annular touchsensor is also detected and distinguished from a tap. Many users desiretactile feedback, and a firm press is accompanied by movement of theannular touch sensor 300, and in some configurations a reassuring“click.” To accomplish this, the annular touch sensor 300 is supportedabove a printed circuit board (PCB) 365 by a flexible molding, spring,or other means that permits the sensor to deflect or tilt in response toa firm press. A number of push button switches 342-354 are disposed inthe space between the PCB 356 and the annular touch sensor 300. Thesepush button switches may be membrane type switches, surface mountmechanical switches mounted to the PCB 356, or other known types ofswitches. In response to a firm press at a particular location upon theannular touch sensor 300, the annular touch sensor deflects or tilts sothat one or more of the switches are activated. Signals from theswitches are received by a micro-controller 360 (for example aprogrammable System-on-Chip (pSOC)), which is also configured to receivesignals from the annular touch sensor 300. The microcontroller 360debounces the signals and reconciles the signals from the switches andthe annular touch sensor 300 to generate commands. These commands aretransmitted to the programmable multimedia controller 100, andresponsive commands may be received back, using an RF Amplifier 370 andan RF Transceiver 380, or another type of interface 390, for example aninfra-red (IR) interface, a Bluetooth™ interface, a ZigBee™ interface, aWirelessUSB™ interface, a Certified Wireless USB interface, and/or aWI-FI interface.

FIG. 4 is a schematic diagram showing front, side and top views of anexample remote control unit 400 that incorporates an annular touchsensor 300. To address, in part, the shortcomings of a button-centricparadigm, the remote control unit 400 is configured to have a minimalnumber of buttons, e.g. 410, 420, 430 visible to the user. In oneembodiment, the buttons 410, 420, 430 are reserved for frequently usedfunctions, such as to activate a menuing system of the programmablemultimedia controller 100, or to return to a previous menu of such amenuing system. In another embodiment, the buttons are used for contextdependent input, such that, depending on the current operational stateof the programmable multimedia controller 100, the buttons havediffering functions. For example, if the programmable multimediacontroller 100 is currently controlling a television, a certain buttonmay control channel selection on the television. Likewise, if theprogrammable multimedia controller is currently being used to providetelephony services, the same button may perform a different function ofinitiating a telephone call.

Also located on the remote control unit 400, is an annular touch sensor300, which is the primary means for entry of user commands. In oneembodiment, the annular touch sensor is used in conjunction with amenuing system presented by the programmable multimedia controller 100,to thereby control both the programmable multimedia controller anddevices interconnected thereto. The menuing system is driven by theprocessing power of the programmable multimedia controller 100, allowingthe remote control unit to possess minimal processing power itself, thusreducing complexity and cost of the controller compared to priorsystems.

The menuing system may be displayed on any of a variety of displaydevices interconnected to the programmable multimedia controller 100,such as televisions 120, computer monitors, desktop displays,touch-screens, or other types of display devices. In some embodiments,the menuing system is displayed on the front panel display 285 of theprogrammable multimedia controller itself, while in other embodiments,the remote control unit 400 includes a display screen for display of themenuing system. Hereinafter, any display device on which the menuingsystem may be displayed will be referred to simply as a “menuing capabledisplay,” and such term should be interpreted broadly to encompass allof the above discussed alternatives, and variations thereof.

Each menuing capable display may display the menuing system on theentire display, i.e. as a full-screen menuing system, or may show themenuing system as an overlay upon a portion of video or still images,i.e. as a partial-screen menuing system. One technique for overlaying amenuing system (or other graphics or text) upon video or still images isdisclosed in SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER,by Robert P. Madonna, et al., and the reader is referred thereto forfurther details. While the technique disclosed therein may be used toadvantage with the present disclosure, it is expressly contemplated thatother techniques may alternately be employed.

During normal operation, a user may focus their attention upon themenuing system on the menuing capable display, and control the remotecontrol unit 400 largely through tactile sensation. In oneconfiguration, the remote control unit 400 is designed to rest mostcomfortably at a particular orientation in the user's hand, such thatthe buttons and annular touch sensor 300 are always at particularpositions with respect to the user's fingers. For example, the roughlycone shaped remote control unit 400 of FIG. 4 fits naturally in a user'shand with the user's palm and fingers wrapped around the circumferenceof the cone, and the user's thumb resting on the top of the cone, withthe top of the cone inclining away from the user. As the remote controlunit is generally always oriented in the same manner when operated, theuser may operate the remote largely without looking thereto.

FIG. 5 is a diagram of a first example annular menuing system 500adapted to the shape of the annular touch sensor 300 of FIG. 3. Such amenuing system may be displayed on any menuing capable displayobservable to the user. The menuing system 500 is composed of aplurality of selectable options 510, 520, 530, 540 displayed in anannular configuration. While only four selectable options are shown inFIG. 5, any number of selectable options may be provided. The annularmenuing system may be two-dimensional, with the selectable options 510,520, 530, 540 arranged in a plane parallel to display screen, or may bethree-dimensional, such that the selectable options 510, 520, 530, 540are arranged in an annular pattern in three-dimensional space, and animage of the three-dimensional space is displayed to the user.Similarly, the selectable options themselves 510, 520, 530, 540 may betwo or three-dimensional representations. In one embodiment, theselectable options 510, 520, 530, 540 are graphic icons, whoseappearances are related to, or otherwise associated with, theirrespective functions. For example, the selectable options 510, 520, 530,540 may be graphic icons representing the devices controlled by theprogrammable multimedia controller 100, and their selection may be usedto indicate one of the devices for further control. Similarly theselectable options 510, 520, 530, 540 may be graphic icons related toInternet web pages, and their selection may be used to navigate to thosewebpages. In another embodiment, the selectable options are textcharacters, such as words, or individual numerals or letters. In such anembodiment, the annular menuing system may be used to input a number,such as a channel number or telephone number, or a text string, such asa name, a postal address, or a URL of a webpage. In this manner, theremote control unit may be used to replace a conventional keyboard andmouse for input and text entry.

To select the different selectable options 510, 520, 530, 540, a usergestures with the annular touch sensor 300 of the remote control unit400. In one embodiment, the user gestures by scrolling with his or herfinger clockwise or counter-clockwise about the annular touch sensor300. In response thereto, the selectable options 510, 520, 530, 540rotate on the menuing capable display. For example, referring to FIG. 5,selectable option 520 may rotate into the position now-occupied byselectable option 510, in response to a clock-wise gesture by the user.In some embodiments, the rate of rotation of the selectable options isrelated to the rate of the user's scrolling on the annular touch sensor300. This may permit fine grain control of the menuing system.

A user may select a selectable option 510, 520, 530, 540 by bringing theoption to a designated location in the annular menuing system 500, forexample to the foreground location of a three-dimensional annularmenuing system, or the bottom location of a two-dimensional annularmenuing system. Once at the designated location, the user selects theselectable option by releasing his or her finger from the annular touchsensor 300, pressing firmly on the annular touch sensor, tapping theannular touch sensor, pressing a button, and/or by performing anotherrecognized action.

In another embodiment, rather than rotating a selectable option to adesignated location in the menuing system 500, the user selects aparticular selectable option by gesturing, for example pressing firmlyor tapping, at a particular position on the annular touch sensor 300. Bygesturing at a position that corresponds to the position of theselectable option in the menuing system 500, the particular selectableoption is chosen. For example, referring to FIG. 5, where fourselectable options are shown oriented in four quadrants, if the usergestures on the right hand portion of the annular touch sensor 300, therightmost selectable option 520 is selected.

FIG. 6A is a diagram of a second example annular menuing system 600adapted to the shape of the annular touch sensor 300 of FIG. 3. Such anannular menuing system may be advantageous for use with numeral input,and such an adaptation is pictured in FIG. 6A. Numerals 0 through 9 areeach displayed in separate regions 610-655. In one embodiment, a movableselection cursor 670 is disposed on the menuing system. In response to auser gesturing on the annular touch sensor 300, by scrolling clockwiseor counter-clockwise, the selection cursor 670 is moved clockwise orcounter-clockwise about the annular menuing system 600. Once theselection cursor is located over the desired region 610-655, the userselects the region, and its associated numeral, by releasing the annulartouch sensor, pressing firmly on the annular touch sensor, tapping theannular touch sensor, or otherwise indicating selection.

In an alternate embodiment, rather than manipulate a selection cursor670, a user selects a region by gesturing, for example by pressingfirmly or tapping, at a particular position on the annular touch sensor300. In response thereto, the region, and the associated numeral, of themenuing system 600 whose position corresponds to that position isselected. For example, referring to FIG. 6A, if the user taps at thevery top of the annular touch sensor 300, the region 640, and therebynumeral 6, in the corresponding position on the menuing system 600 isselected.

Numerals input by the menuing system 600 may be used in a variety ofmanners by the programmable multimedia controller 100. For example, thenumerals may be used to enter channel numbers for television viewing, toinput telephone numbers for telephony functions, or to interact withonline purchasing services. A fuller listing of possible functions andservices with which numeral entry may be used is found in MULTIMEDIACONTROLLER WITH PROGRAMMABLE SERVICES, by Robert P. Madonna, et al., andthe reader is referred thereto for greater detail.

Further, while the above description discusses selection of numeralswith the menuing system 600, the menuing system may readily be adaptedfor other types of input, such as character input, with letters assignedto each region; string input, with several characters (i.e. words)assigned to each region; or device selection, with device icons or namesassociated with each region. As such, the description of the menuingsystem 600 should be interpreted broadly and not be limited toparticular type of input or selection.

Also, while annular menuing systems are described above, it should berememtiered that the menuing system need not be annular in allconfigurations. FIG. 6B is a diagram of an example linear menuing system601 that may be controlled by gestures on the annular touch sensor 300.While the example in FIG. 6B is adapted for numeral input, with regions611-656 associated with the numerals 0-9, such a linear menuing system601 may readily be used to facilitate character input, with letters A-Zeach associated with each region, or alternately string input or controlinput. A selection cursor 671 is disposed upon the linear menuing system601. In response to the user gestures by scrolling with his or herfinger clockwise or counter-clockwise about the annular touch sensor300, the selection cursor 671 is moved rightwards or leftwards. That is,annular movement on the annular touch sensor 300 is translated to linearmovement of the selection cursor 671 in the linear menuing system 601.Once the selection cursor 671 is located over the desired region611-656, the user selects the region, by releasing the annular touchsensor, pressing firmly on the annular touch sensor, tapping the annulartouch sensor, or otherwise indicating selection.

Furthermore, while several menuing systems have been described hereinfor use with the annular touch sensor 300, it should be remembered thata menuing system need not always be employed with the sensor. In oneembodiment, rather than being used to manipulate a menuing system,gestures on the annular touch sensor 300 have predefined meanings, apartfrom any menuing system. By entering a particular gesture, an associatedcommand is triggered. For example, if a television is currently beingcontrolled by the programmable multimedia controller 100, pressingfirmly or tapping on the upper or lower portions of the annular touchsensor is interpreted to increment or decrement the channel number shownon the television. Similarly, pressing firmly or tapping on theleft-side or right-side portions of the annular touch sensor isinterpreted to raise or lower the volume of the television. In anotherembodiment, if a video camera is currently being controlled by theprogrammable multimedia controller 100, gesturing by scrolling clockwiseor counter-clockwise on the annular touch sensor 300 is interpreted topan the video camera left or right. In this manner, the annular touchsensor may be used with a variety of control functions absent a menuingsystem.

In addition to employing an annular touch sensor 300, the example remotecontrol unit 400, is configured to implement location-awarenessfeatures. FIG. 7 is a schematic diagram depicting an example techniquefor providing location-awareness to the remote control unit 400. Anumber of transmitter/receiver units 710, 720, 730 are dispersedthroughout a structure where the programmable multimedia controller 100is located, for example the user's home. The units 710, 720, 730 may belocated on separate floors, in separate rooms, or even in differentportions of the same room depending upon the desired level oflocation-awareness. Each transmitter/receiver unit is connected back tothe programmable multimedia controller 100 by a wired connection, suchas an Ethernet cable providing Power over Ethernet (PoE) service, or bya wireless connection, for example a WI-FI connection. Further, eachtransmitter/receiver unit 710, 720, 730, as well as the programmablemultimedia control 100 itself, implements a wireless interface forcommunicating with the remote control unit 400. The wireless interfacemay be any of a variety of known interfaces, for example an infra-red(IR) interface, a radio-frequency (RF) interface, a Bluetooth™interface, a ZigBee™ interface, a WirelessUSB™ interface, a CertifiedWireless USB interface, and/or a WI-FI interface.

Depending on the location of the remote control unit 400, a signaltransmitted there from is received by one or more transmitter/receiverunits 710, 720, 730 and/or the programmable multimedia controller 100itself. According to one embodiment, if the signal is received by onlyone device, the location of that device is associated with the remotecontrol unit 400. If the signal is received by several devices, thesignal strength at each device is measured and compared, and thelocation of the device that detects the strongest signal is associatedwith the remote control unit 400. For example, if the signal transmittedby the remote control unit 400 is received by two transmitter/receiverunits 720, 730 as well as the programmable multimedia control 100, and aparticular transmitter/receiver unit 720 detects the greatest signalstrength, the remote control unit 400 is associated with location ofthat transmitter/receiver unit 720.

According to another embodiment, rather than measure signal strength,the devices employ triangulation techniques to determine a location ofthe remote control unit 400 with respect to the transmitter/receiverunits 710, 720, 730. By employing triangulation techniques a limitednumber of transmitter/receivers may be used, while a very preciselocation for the remote control unit provided.

In yet another embodiment, global positioning techniques may be employedwith the remote control unit 400. The remote control unit 400 mayinclude a global positioning system (GPS) receiver that determines aprecise location from received GPS signals. This location is thentransmitted from the remote control unit 400 to the programmablemultimedia controller 100.

Once the location of the remote control unit 400 is determined, theprogrammable multimedia controller 100 adapts control functions inaccord with the devices that are proximate to that location. In oneembodiment, a menuing system is displayed on the menuing capable displaymost proximate to the location of the remote control unit. For example,suppose a first television (not shown) that is connected to theprogrammable multimedia controller 100 is located proximate to a firsttransmitter/receiver unit 710 and a second television (not shown) thatis connected to the programmable multimedia controller 100 is locatedproximate to a second transmitter/receiver unit 720, and remote controlunit is located near the second transmitter/receiver unit 720. Inresponse to the user manipulating the remote control unit 400, a menuingsystem may be automatically displayed on the second television, absentany user specification of that display. Suppose also that, at some latertime, the user leaves the location, i.e. walks to another room, and theremote control unit 400 comes to be located near the firsttransmitter/receiver unit 710. The programmable multimedia controller100 is configured to recognize this change, and in response thereto, nowdisplay the menuing system on the first television that is nearby thefirst transmitter/receiver unit 710.

In addition to providing location-awareness features, eachtransmitter/receiver unit itself may implement control features. In oneembodiment, a transmitter/receiver unit includes a plurality of buttonsand/or an annular touch sensor. These buttons and annular touch sensoroperate to control the programmable multimedia control in a similarmanner to the buttons and touch sensor on the remote control unit. Thusa user is given an option of using a remote control unit, or atransmitter/receiver unit to input control choices.

In another embodiment, the particular device activated or controlled byan action on the remote control unit 400 depends on the location of theremote control unit. For example, suppose a user enters a command on theremote control unit to turn on a television for viewing. If the user islocated most proximate to the second television, the second televisionmay be activated without explicit user specification. Alternately, ifthe user is located nearby the first television, that television may beactivated instead. In such manner, the user is freed from explicitlyselecting a television, and such selection instead is made by theprogrammable multimedia controller 100 in response to locationinformation and assumptions regarding typical user activities. If theassumptions made by the programmable multimedia controller prove to beincorrect, the user may always override the selection and explicitlyspecify the device to be controlled according to well known techniques.

In a further example, location-awareness may be applied to the area oflighting control. Suppose a number of lighting fixtures are controlledby a lighting controller (not shown) interconnected to the programmablemultimedia controller 100 and a button on the remote control unit 400 ismapped to a “light switch” function, to activate or deactivate lightingfixtures. Depending on the location of the remote control unit 400,light fixtures proximate to the location are controlled by the button,i.e. the lights in that room turned on or off. If a user walks toanother location, i.e. to another room, the lights therein will becontrolled by the button absent explicit specification of the newlighting fixtures or of the new room entered.

While the above embodiments discuss televisions and lighting fixtures,location-aware control may be readily applied to any of the devicescontrolled by the programmable multimedia controller. Accordingly, it isexpressly contemplated that a variety of audio, video, telephony, data,security, motor-operated, relay-operated, and/or other types of devicesmay be controlled in response to location information.

Further, while the above described techniques discuss determining thelocation of the remote control unit with transmitter/receiver units 710,720, 730, alternately, the location of the remote control unit 400 maybe determined in another manner. For example, each remote control unitmay be configured to include a Radio Frequency Identification (RFID)transponder, and a number of RFID scanners (not shown) dispersed atdifferent locations. Upon entering a new location, the user may move theremote control unit into proximity of the RFID scanner to record theremote control unit's location. In another alternative, the remotecontrol unit 400 may be physically coupled, i.e. docked, with a baseunit at a particular location. In response thereto, the location of theremote control unit may be determined by the base unit to which it iscoupled.

In addition to location-aware control, in another embodiment each remotecontrol unit is configured provide user-aware control. A number ofremote control units are provided for use with the programmablemultimedia controller, each associated with a particular user. When auser manipulates his or her particular remote control unit, a userprofile is accessed and user-specific options applied to the controlscheme. For example, a user may have selected certain menu arrangementsand styles that suit particular preferences. These arrangements andstyles are displayed when the user manipulates his or her particularremote control unit. Similarly, a user may have access to certaindevices or services controlled or offered by the programmable multimediacontroller, while another user may not. For example, a user who is ayoung child may not have access to certain channel which may containadult content, or to certain configuration options where the systemsfunction may be changed in an unwanted manner, while a user who is anadult may have complete control. In this manner different users, throughuse of their particular remote control units, may have different controlprivileges.

The foregoing description has been directed to particular embodiments ofthis disclosure. It will be apparent, however, that other variations andmodifications may be made to the described embodiments, with theattainment of some or all of their advantages. While the abovedescriptions mainly discuss a remote control unit connected via awireless interface, a wired interface may alternately be employed. Inone embodiment, this wired interface may take the form of a Power overEthernet (PoE) interface to the programmable multimedia controller, suchthat in addition to the interchange of control information, power may besupplied by the interface. Further, while the above descriptions discussthe remote control unit working with a programmable multimediacontroller, the remote control unit may alternately be configured workwith just a conventional general purpose computer and attached displayscreen. In such a configuration, the remote control unit may be used tocontrol the general purpose computer's functions through a menuingsystem displayed on the computer's monitor. For example, a user may usethe remote control unit and menuing system to control an Internetbrowsing function of the computer to interaction with online services.

Additionally, the procedures or processes described above may beimplemented in hardware, software, embodied as a computer-readablemedium having program instructions, firmware, or a combination thereof.Therefore, it is the object of the appended claims to cover all suchvariations and modifications as come within the true spirit and scope ofthe invention.

What is claimed is:
 1. A method comprising: overlaying a menuing systemupon a portion of a video being shown on a display device coupled to aprogrammable multimedia controller, the portion of the video being lessthan an entire screen of the video such that at least some of the videois still visible, the menuing system having a plurality of selectableoptions; receiving, on a touch sensor of a unit separate from thedisplay device, a scrolling gesture in a direction; in response to thescrolling gesture in the direction, moving an element in a correspondingdirection within the menuing system to bring the element to a designatedposition in the menuing system, the designated position to permitselection of a particular selectable option; and in response toselection of the particular selectable option, issuing, by theprogrammable multimedia controller, one or more control commands to adevice coupled to the programmable multimedia controller to control anaspect of operation of the device.
 2. The method of claim 1, wherein theelement is the particular selectable option and the moving comprises:moving the particular selectable option in the corresponding directionwithin the menuing system to bring the particular selectable option tothe designated position.
 3. The method of claim 1, wherein the elementis a selection cursor and the moving comprises: moving the selectioncursor in the corresponding direction within the menuing system to bringthe selection cursor to the designated position.
 4. The method of claim1, wherein the video being shown on the display device is a video from aseparate video source coupled to the programmable multimedia controller.5. The method of claim 1, wherein the menuing system is an annularmenuing system, and the plurality of selectable options are arranged inan annular configuration.
 6. The method of claim 1, wherein at leastsome of the plurality of selectable options represent devices coupled tothe programmable multimedia controller, and selection of the particularselectable option designates the particular device to receive controlcommands.
 7. The method of claim 1, wherein the touch sensor is anannular touch sensor and the scrolling gesture in the direction is ascrolling gesture in a clockwise or counter-clockwise direction.
 8. Themethod of claim 1, wherein the unit having the touch sensor is a remotecontrol unit and the display device is a television.
 9. A method forcomprising: overlaying a menuing system upon a portion of a video beingshown on a menuing capable display observable by a user, the portion ofthe video being less than an entire screen of the video such that atleast some of the video is still visible, the menuing system having aplurality of selectable options; receiving, on a touch sensor, ascrolling gesture in a direction; in response to the gesture in thedirection, moving the plurality of selectable options in a correspondingdirection within the menuing system to bring a particular selectableoption to a designated position in the menuing system, the designatedposition to permit selection of the particular selectable option; and inresponse to selection of the particular selectable option, issuing oneor more control commands.
 10. The method of claim 9, wherein the menuingcapable display is coupled to a programmable multimedia controller, andthe issuing the one or more control commands is performed by theprogrammable multimedia controller to a device under control of theprogrammable multimedia controller.
 11. The method of claim 9, whereinthe menuing system is an annular menuing system and the plurality ofselectable options are arranged in an annular configuration.
 12. Themethod of claim 9, wherein at least some of the plurality of selectableoptions represent devices, and selection of the particular selectableoption designates a particular device.
 13. The method of claim 9,wherein the touch sensor is an annular touch sensor, and the gesture inthe direction is a gesture in a clockwise or counter-clockwisedirection.
 14. A system comprising: a programmable multimediacontroller; a unit having a touch sensor in communication with theprogrammable multimedia controller, the touch sensor responsive toscrolling gestures there upon by a user, the unit separate from theprogrammable multimedia controller; a display device coupled to theprogrammable multimedia controller and separate from the unit having thetouch sensor; and an menuing system configured to be overlaid upon aportion of a video being shown on the display device, the portion of thevideo being less than an entire screen of the video such that at leastsome of the video is still visible, the menuing system having aplurality of selectable options, the menuing system configured to, inresponse to a scrolling gesture on the touch sensor, move an element ina direction within the menuing system to bring the element to adesignated position in the menuing system, the designated position topermit selection of a particular selectable option; and wherein theprogrammable multimedia controller is configured to, in response toselection of the particular selectable option, issue one or more controlcommands to a device coupled to the programmable multimedia controllerto control an aspect of operation of the device.
 15. The system of claim14, wherein the element is the particular selectable option.
 16. Thesystem of claim 14, wherein the element is a selection cursor.
 17. Thesystem of claim 14, further comprising: a video source coupled to theprogrammable multimedia controller, the video source configured toprovide the video being shown on the display device.
 18. The system ofclaim 14, wherein the menuing system is an annular menuing system, andthe plurality of selectable options are arranged in an annularconfiguration.
 19. The system of claim 14, wherein at least some of theplurality of selectable options represent devices coupled to theprogrammable multimedia controller, and selection of the particularselectable option designates a particular device to receive controlcommands.
 20. The system of claim 14, wherein the unit having the touchsensor is a remote control unit that further has a button, and whereinthe menuing system is further configured to select the particularselectable option in response to operation of the button.